Honein-AbouHaidar et al. BMC Cancer 2014, 14:537 
http://www.biomedcentral.com/1471-2407/14/537 



(bmc 



Cancer 



RESEARCH ARTICLE Open Access 



Evaluating the impact of public health initiatives 
on trends in fecal occult blood test participation 
in Ontario 

Gladys N Honein-AbouHaidar 1 , Linda Rabeneck 23,4 ' 5,6 , Lawrence F Paszat 6,7 , Rinku Sutradhar 2,6 , 
Jill Tinmouth 4 ' 5 ' 6 ' 7 ' 8 and Nancy N Baxter 5 ' 6 ' 9 * 



Abstract 

Background: Since the publication of two randomized controlled trials (RCT) in 1996 demonstrating the 
effectiveness of fecal occult blood test (FOBT) in reducing colorectal cancer (CRC) mortality, several public health 
initiatives have been introduced in Ontario to promote FOBT participation. We examined the effect of these 
initiatives on FOBT participation and evaluated temporal trends in participation between 1994 and 2012. 

Method: Using administrative databases, we identified 18 annual cohorts of individuals age 50 to 74 years eligible 
for CRC screening and identified those who received FOBT in each quarter of a year. We used negative binomial 
segmented regression to examine the effect of initiatives on trends and Joinpoint regression to evaluate temporal 
trends in FOBT participation. 

Results: Quarterly FOBT participation increased from 6.5 per 1000 in quarter 1 to 41.6 per 1000 in quarter 72 
(January-March 2012). Segmented regression indicated increases following the publication of the RCTs in 1996 
(A slope = 6%, 95% CI = 4.3-7.9), the primary care physician financial incentives announcement in 2005 (A slope = 
2.2%, 95% CI = 0.68-3.7), the launch of the ColonCancerCheck (CCC) Program (A intercept = 35.4%, 95% CI = 18.3 -54.9), 
and the CCC Program 2-year anniversary (A slope = 7.2%, 95% CI = 3.9 - 10.5). Joinpoint validated these findings and 
identified the specific points when changes occurred. 

Conclusion: Although observed increases in FOBT participation cannot be definitively attributed to the various 
initiatives, the results of the two statistical approaches suggest a causal association between the observed increases in 
FOBT participation and most of these initiatives. 

Keywords: Public health policy, Colorectal cancer screening, Epidemiologic study 



Background 

The population health burden of colorectal cancer (CRC) 
in Canada is substantial [1]. In Ontario, Canada, CRC is 
the second cause of cancer mortality [1]. Screening for 
CRC can reduce the burden of this disease. Three land- 
mark randomized controlled trials (RCTs) published be- 
tween 1993 and 1996 demonstrated that biennial use 
of the fecal occult blood test (FOBT), coupled with colonos- 
copy in those who test positive, resulted in a 15% reduction 
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in CRC mortality [2-4]. The publication of these RCTs moti- 
vated policy makers to make various efforts to promote 
FOBT participation in Ontario. 

In February 2001, the Canadian Task Force on Preventive 
Health Care (CTFPHC) published guidelines recommend- 
ing FOBT as a CRC screening test for average risk indi- 
viduals aged 50 to 74 years (Level A Recommendation) 
[5]. The dissemination of these guidelines into clinical 
practice was passive and without any mechanism to pro- 
mote adherence. 

In July 2005, the Ministry of Health and Long-Term 
Care (MOHLTC) of Ontario announced new financial in- 
centives for CRC screening targeting primary care physi- 
cians (PCPs) in patient enrolment model (PEM) types of 
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practice (50% of Ontario physicians at that time) [6]. Eli- 
gible PCPs received end of fiscal year bonuses based on 
the proportion of enrolled patients who received FOBT 
prior to March 31 s of each year. The bonus amount in- 
creases as the proportion of screened patients increases, 
e.g. if 20% of enrolled patients are screened, the PCP re- 
ceives $440; if 50% are screened, the PCP receives $2,200. 
The first bonus submission was on April 1 st of 2006 for 
FOBT screening of enrolled patients from April 1 2005 
through March 31 2006 [7], 

In April 2008, Cancer Care Ontario, Ontario's provin- 
cial cancer agency responsible for cancer services, and 
the MOHLTC launched the ColonCancerCheck (CCC) 
Program, the first province-wide organized CRC screen- 
ing program in Canada. The CCC Program recommends 
FOBT every 2 years for average risk individuals age 50 to 
74 years and colonoscopy for those who test positive [8]. 
An intense but temporary public media campaign and a 
PCP educational program marked the launch of the CCC 
Program. Starting from fiscal year 2008, PCPs became eli- 
gible to receive up to $4,000 if 70% of their enrolled pa- 
tients were screened [9-12]. 

April 2010 marked the CCC Program 2- year anniver- 
sary. In addition to ongoing PCP screening practices, the 
CCC Program rolled out recall and reminder letter inter- 
ventions. Recall letters were sent out to those who were 
FOBT negative in the first round of screening inviting 
them to be re-screened. These recall letters were sent in 
August 2010 for those who completed FOBT in the pre- 
vious 24-30 months and in December 2010, a reminder 
letter was sent for those who had not yet undergone 
FOBT screening [13]. 

The goal of this population-based time trend study was 
to examine the effect of the publication of the RCTs and 
the CTFPHC guidelines, the announcement of PCP finan- 
cial incentives, the launch of the CCC Program, and the 
programmatic correspondence following the CCC Program 
2-year anniversary on FOBT participation in Ontario and 
to evaluate temporal trends in FOBT participation between 
April 1 st 1994 and March 31 st 2012. 

Methods 

The Research Ethics Board of St. Michael's Hospital in 
Toronto approved this study. 

Data sources 

We used four data holdings including the Registered 
Persons Database (RPDB), the Ontario Health Insurance 
Plan (OHIP) database, the Ontario Cancer Registry (OCR), 
and the Canadian Institute for Health Information 
Discharge Abstract Database (CIHI-DAD). These data 
holdings are housed at the Institute for Clinical Evaluative 
Sciences (ICES) [14]. Each data record collected at 
ICES comes with personal identifier, usually a health 



card number. Using a secure ICES algorithm, each health 
card number is assigned a unique encrypted ICES number 
(IKN). Once records in a data set have an IKN assigned, 
the identifying information is stripped off the file and 
the data become de-identified. Researchers have access 
to the de-identified data only. The unique IKN is used to 
link the various data sets. 

The RPDB is a roster of all permanent residents and 
refugees eligible for coverage under the Ontario Health 
Insurance Plan, which contains demographic information 
including an individual's date of birth, sex, date of death 
(where applicable), and changes in eligibility for health in- 
surance coverage. The OHIP database contains informa- 
tion about all claims for physician and laboratory services 
provided to Ontario residents since July 1991. The OCR is 
a registry of all Ontario residents diagnosed with cancer 
since 1964. The OCR captures over 95% of cancer cases in 
Ontario [15]. The CIHI-DAD contains information from 
hospitalization records, abstracted since April 1988. 

Study cohorts 

All persons eligible for OHIP aged 50 to 74 years were 
identified from the RPDB at the beginning of each fiscal 
year from 1994 to 2012. Using IKN, we linked these co- 
horts to OCR and CIHI-DAD to exclude individuals diag- 
nosed with CRC or Inflammatory Bowel Disease before 
April 1st of each year to approximate cohorts of individ- 
uals at average risk for CRC. (Additional file 1: Diagnostic 
and OHIP procedure codes). 

We used OHIP database to identify those who re- 
ceived CRC screening tests in each fiscal year and in the 
previous ten years (Additional file 1). For persons with 
multiple claims in a fiscal year, we included the first ser- 
vice date for FOBT; for persons with multiple claims in 
the previous 10 years we included the most recent ser- 
vice date for this time period. 

The data were analyzed by quarter of a fiscal year. For 
each quarter, we included all individuals due for CRC 
screening in our denominator; individuals who under- 
went FOBT during the quarter formed our numerator. 
We applied the following exclusions to approximate a 
population that was due for CRC screening: 

1- At the beginning of each quarter, we excluded those 
who died in the previous quarter(s) of the same year; 

2- At the end of each quarter, we excluded those 
who were up-to-date with CRC screening as defined 
as having: FOBT within two years; a flexible 
sigmoidoscopy or barium enema within five years; 
or a colonoscopy within ten years. 

Statistical analysis 

We used two statistical methods. We used a segmented 
regression analysis to compare changes in trends in FOBT 
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participation before and after initiatives including: publica- 
tion of RCTs (1996), publication of the CTFPHC guide- 
lines (2001), announcement of PCP financial incentives 
(2005), launch of the CCC Program (2008), and the pro- 
grammatic correspondence following the CCC Program 
2-year anniversary (2010). In this analysis, a dummy 
variable (INT) coded 0 before and 1 after the ex- 
pected time of each intervention, and an interaction 
term (INT'Timeafter) were added to the model as sug- 
gested by Wagner et al. [16]. The dummy variable (INT) 
indicates change in intercept, the interaction term indi- 
cates change in slope (Detailed procedure of statistical 
analysis is shown in Additional file 2). A change in slope 
or intercept was considered statistically significant if the 
95% confidence interval did not include zero. Data were 
analyzed using SAS software 9.3. [17]. 

Because segmented regression uses pre-defined points, 
the results may mask the specific date when the actual 
change in trend occurred [18]. We, therefore, conducted 
a Joinpoint regression (ver. 4.0) a technique that enables 
trend modeling without pre-defined points [19,20]. We 
fitted the joinpoint regression model as follows: we 
used FOBT count in each quarter as the numerator, 
individuals due for CRC screening (denominator) as an 
"offset term", and the quarter as the regressor variable. 
We estimated the quarterly percent change (QPC), 
i.e. rate of change in slope between joinpoints, the inter- 
cept of each joinpoint, and corresponding 95% confidence 
intervals using the following parameters: 1) Grid Search 
method; 2) Bayesian Information Criteria model selection 



method; 3) up to 6 joinpoints for each model; 4) a mini- 
mum of 5 quarters between two joinpoints; and 5) Poisson 
variance [21]. The trend was considered statistically sig- 
nificant if the 95% confidence interval of the QPC did not 
include zero [18,20-24]. 

Results 

Cohort characteristics 

From fiscal year 1994 to 2012, there were 72 quarters. In 
each quarter, we identified 198,000 to 207,000 individuals 
due for CRC screening. Quarterly FOBT participation in- 
creased from 6.5 in quarter 1 to 41.6 per 1000 in quarter 
72 with a peak in quarter 69 (April-June, 2011), after the 
programmatic correspondence of the CCC Program (45.9 
per 1000). Figure 1 demonstrates an overall increase in 
FOBT participation between 1994 and 2012 that was not 
uniform throughout the time period. Participation slowly 
increased between 1996 and 2005; more rapid increases 
occurred after 2005. 

Segmented regression results 

We plotted the observed and adjusted quarterly rates of 
FOBT participation in each quarter (Figure 1). The re- 
sults of the segmented regression analysis are shown in 
Table 1. 

There was a statistically significant increase in slope in 
FOBT participation following the publication of the 
RCTs in 1996 (change in slope = 6.1%, 95% CI = 4.3-7.9), 
and the announcement of PCP financial incentives (change 
in slope = 2.2%, 95% CI = 0.7-3.8). The launch of the CCC 



Annoucement of 
AnHKfjl incentives 



CCC prog/am launch CCC program 




Figure 1 Observed rates and segmented regression adjusted rates of fecal occult blood test (FOBT) participation per 1000, Ontario, 
1994-2012. Observed rate = (FOBT completed per quarter/ population due for CRC screening per quarter)* 1000. Adjusted rate = (Exp 
(log rate-offset))*1 000. Rates are connected by a binomial regression line. Dashed vertical lines indicate quarter when the following i 
nitiatives were enacted: RCT: Publication of the second and third randomized controlled trials in November 1996. CTFPHC: Publication 
of the Canadian Task Force on Preventive Health Care guidelines for CRC screening in February 2001. Announcement of PCP financia 
incentives in July 2005. CCC Program launch, April 2008. CCC Program 2-year anniversary, April 2010. The regression model was expressed as: 
Log (FOBT completed per quarter/population due for CRC screening per quarter) = 

5 5 

a + j3, quarter + ^ /3j INT (quarter > INTj) + V] pj INT* Timeafter ((quarter > INTj)*(quarter-INTj)). 
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Table 1 Segmented regression analysis showing changes in intercept and changes in slope on FOBT participation rates 
following each initiative, 1994-2012 



Initiative (Segment) Intercept* Slope 





Change in Intercept (A) 


95% CI 


Change in slope (A) 


95% CI 


Baseline (April 94-October 96) 






-2.4 ¥ * 


(-3.9-0.9) 


RCT (October 96-January 01) 


-3.2 


(-13.1-7.9) 


6.1* 


(4.3-7.9) 


CTFPHC (January 01-July 05) 


6.8 


(-2.8-17.3) 


0.3 


(-0.6-1.3) 


Fl (July 05- April 08) 


-1.5 


(-11.9-10.1) 


2.2* 


(0.7- 3.8) 


CCC launch (April 08-April 10) 


35.4* 


(18.3-54.9) 


-9.7* 


(-12-7.4) 


2-year anniversary (April 10 -March 12) 


13.5 


(-1.6-30.9) 


7.2* 


(3.9-10.5) 



'Difference between pre and post initiative intercepts interpreted as step change and calculated as QPC = (exp (3| NTi -1 )* 100. 

A Difference between pre and post initiative slopes taking into account the trend before the initiative and calculated as QPC = (exp (Sinttime -1 )* 1 nn - 
¥Baseline slope. 

^Statistically significant if 95% confidence interval does not cross zero. 

RCT: Publication of the second and third randomized controlled trials in November 1996. 

CTFPHC: Publication of the Canadian Task Force on Preventive Health Care guidelines for CRC screening in February 2001. 

Fl: Announcement of PCP financial incentives in July 2005. 

CCC launch: ColonCancer Check program (CCC) Program launch, April 2008. 

2 - year anniversary: ColonCancerCheck Program 2-year anniversary, April 2010. 



Program was associated with increase in intercept (change 
in intercept = 35.4%, 95% CI = 18.3-54.9) followed by a 
decrease in slope (change in slope = -9.75%, 95% CI = -12- 
7.4). An increase in slope was detected following the CCC 
Program correspondence in 2010 (change in slope: 7.2%, 
95% CI = 3.9-10.5). Other changes in intercept and slope 
were not statistically significant (Table 1). 

Joinpoint results 

We plotted the observed rates of FOBT participation per 
quarter and the Joinpoint location in Figure 2. The re- 
sults of the Joinpoint regression analysis are shown in 
Table 2. 

Joinpoint regression analysis identified five joinpoints 
and six distinct segments. The change in slopes between 



Joinpoints and those from the segmented regression 
analysis converged. Joinpoint regression identified the 
specific point in time when change occurred, the slope 
between joinpoints, and the intercept at each joinpoint. 
An increase in slope started two quarters following RCT 
publication in 1996 (QPC =3.8%, 95% CI =3.4-4.2), 
followed by another increase in slope starting from 
the quarter PCP financial incentives were announced 
(QPC = 7.4%, 95% CI = 6.4-8.5). There was an immedi- 
ate increase in intercept following the CCC Program 
launch (Intercept =62.1, 95% CI: 59-64.9), a decrease 
in slope three quarters after the launch (QPC = -5.5%, 
95% CI = -9.9-0.9), and an increase in slope one quarter 
before the CCC Program 2-year anniversary (QPC = 8.2%, 
95% CI = 0.9-16) (Table 2). 
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Figure 2 Observed rates of FOBT participation per 1000 and joinpoint location determined by Joinpoint regression analysis, Ontario, 
1994-2012. Observed rate = (FOBT completed per quarter/population due for CRC screening per quarter)* 1000. * joinpoint location. Dashed 
vertical lines indicate quarter when the following initiatives were enacted: RCT: Publication of the second and third randomized controlled trials 
in November 1996. CTFPHC: Publication of the Canadian Task Force on Preventive Health Care guidelines for CRC screening in February 2001. 
Announcement of PCP financial incentives in July 2005. CCC Program launch, April 2008. CCC Program 2-year anniversary, April 2010. 
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Table 2 Joinpoint regression analysis for FOBT participation in Ontario, 1994-2012 showing actual intercept at each 
joinpoint and actual slope between joinpoints 



Identified segment 


Join-point 




Intercept 




Slope 


Intercept' 


95% CI 


QPC A 


95% CI 


April 1994-April 1997 




0.3 


(0.15-0.47) 


-1.7 ¥ 


(-3.9-0.5) 


April 1997-July 2005 


Q 13 


0.15* 


(0.02-0.28) 


3.8* 


(3.4-4.2) 


July 2005-October 2009 


Q46 


0.03 


(-0.47-0.53) 


7.4* 


(6.4-8.5) 


October 2009-January 2010 


Q 59 


62.1* 


(59-64.9) 


-5.5* 


(-9.9-0.9) 


January 2010-January 201 1 


Q 64 


0.01 


(-4.5-4.5) 


8.2* 


(0.9-16) 


January 2011-March 2012 


Q 68 


6* 


(3.1-8.9) 


-1.4 


(-5.5-2.9) 



'intercept at each joinpoint calculated as (exp (3 intercept i)- 

A Quarterly percent change (slope) between joinpoints calculated as (exp p slopei -1)* 100. 
¥Baseline trend. 

^Statistically significant if 95% confidence interval does not cross zero. 



Discussion 

Since 1994, FOBT participation has increased substantially 
in Ontario. We observed an overall increase in quarterly 
participation from 6.5 per 1000 in April 1994 to 41.6 per 
1000 in March, 2012. Participation slowly increased be- 
tween 1994 and 2005 followed by a more rapid increase 
between 2005 and 2012. Although we cannot definitively 
attribute the observed increases in FOBT participation to 
the initiatives made to promote participation, the con- 
vergence of the two statistical approaches suggest a causal 
association between the observed increases in FOBT par- 
ticipation and the publication of the RCTs, introduction of 
PCP financial incentives and CCC Program launch and 
programmatic correspondence, but not publication of the 
CTFPHC guideline. 

We previously reported the results of a segmented re- 
gression to investigate the effect of the launch of the CCC 
Program on FOBT participation in Ontario over a 6 year 
time period (2005 to 2011) [25]. Our current study im- 
proves upon this analysis by evaluating 18 years of data 
allowing examination of initiatives before CCC Program 
launch, enabling the evaluation of CCR program in context 
of previous trends in FOBT uptake, and evaluation of the 
programmatic correspondence of the 2-year anniversary 
of the CCC Program. Further, this study uses two dif- 
ferent statistical approaches, each with specific advantages. 
Segmented regression analysis allowed us to estimate the 
changes in intercepts and slopes following each intervention 
accounting for baselines trends, a robust method for meas- 
uring the effect of an intervention when randomization or 
identification of a control group are impractical [16,26-28]. 
Joinpoint analysis enabled identification of specific points 
in time when changes occurred, and provided estimates of 
the actual intercept and slope for each segment. 

Previously, we reported a significant increase in FOBT 
participation (change in intercept) immediately following 
the launch of the CCC Program; we attributed the in- 
crease to the public media campaign [25]. This increase 



was followed by a downtrend at the end of the screening 
period, a concern for policy makers (Dr. Linda Rabeneck, 
personal communication, January 2009). In the current 
study, we found that this downtrend was reversible and 
was observed again after the CCC Program 2-year anni- 
versary, i.e. a peak after the programmatic correspondence 
followed by a drop at the end of the study period. Fluctu- 
ation in trends following the introduction of public pol- 
icies are reported in the literature [29]. In this instance, 
however, a periodic trend in FOBT participation with a 
peak every 2 years has likely been introduced, in keeping 
with the date of program launch and program recommen- 
dation of biennial FOBT screening. Future studies need to 
examine if this biennial periodicity will persist and the im- 
pact on endoscopic and surgical resources. 

In 1996, results of RCTs demonstrated that screening 
with FOBT reduces CRC mortality and in 2001 the 
CTFPHC strongly endorsed CRC screening with FOBT. 
Given this evidence, why increases in FOBT participation 
before 2005 were modest? Integration of evidence into 
clinical practice has always been challenging [30-32] . Davis 
et al. indicated that in order for guidelines to be translated 
into practice, there must be intervention strategies to 
reinforce their adoption such as reminder systems and aca- 
demic detailing [31]. Passive strategies, including mailing 
or publication of guidelines, have little impact on adoption 
[31]. Because there was no mechanism to actively promote 
the CTFPHC guidelines, the modest increase in the use of 
FOBT after their publication is not surprising. 

We demonstrated a marked change in participation 
following the introduction of financial incentives and the 
programmatic correspondence after the CCC Program 
2-year anniversary, indicating these initiatives were likely 
the reasons for the rapid increase in participation after 
2005. In terms of financial incentives, studies show mixed 
effects on performance varying between no effect at all 
[33,34] and improved performance [35-38]. Certain factors 
have proven to be effective in improving performance. 
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Custers et al. indicate that financial incentives that take 
into account the size of the bonus, and baseline perform- 
ance often succeed in improving performance [39]. In this 
study, two factors may explain the improved performance. 
First, the size of the reward may have motivated some 
physicians to change their screening routines [34,40] . Sec- 
ond, when baseline performance is relatively modest, the 
introduction of bonuses is more likely to have an impact 
[41]. Our findings that participation increased following 
the programmatic correspondence are consistent with 
those from previous studies that suggested that reminder 
letters were associated with increased screening participa- 
tion [42-46]. 

Our study has limitations. In observational studies, it is 
difficult to infer a causal association between an interven- 
tion and observed trends [47]. We are examining changes 
in FOBT participation occurring in a complex health sys- 
tem, and factors other than those evaluated in this study 
may have contributed to changes in trend. However, seg- 
mented regression analysis controls for secular trends, 
i.e. reasons other than the effect of initiatives, by introdu- 
cing a term in the model to test the effect of the interven- 
tion over and above the secular trend [16,48]. 

Conclusion 

FOBT participation in Ontario slowly increased between 
1994 and 2005 followed by a more rapid increase be- 
tween 2005 and 2012. The results of the two statistical 
methods suggest a causal association between those in- 
creases and publication of the RCTs, introduction of PCP 
financial incentives and CCC Program launch and pro- 
grammatic correspondence, but not the CTFPHC guideline 
publication. We particularly observed a marked increase 
after the introduction of the CCC Program in 2008. Al- 
though this increase cannot be solely attributed to the CCC 
Program, evidence from the literature suggests that orga- 
nized screening programs are effective in increasing partici- 
pation. Furthermore, we noted a marked increase following 
the programmatic correspondence after the CCC Program 
2-year anniversary. With the information available, it is rea- 
sonable to conclude that the marked increase in participa- 
tion since 2008 might well reflect the impact of the CCC 
Program on FOBT participation. 
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